Consortium for Reliability and Reproducibility (CoRR)

The goal of CoRR was to create an open science resource for the imaging community that facilitates the assessment of test-retest reliability and reproducibility for functional and structural connectomics. In order to accomplish this, we have aggregated resting state fMRI (R-fMRI) and diffusion imaging data from laboratories around the world, and are sharing the data via the International Neuroimaging Data-sharing Initiative (INDI). This enables the:

1. Establishment of test-retest reliability and reproducibility for commonly used MR-based connectome metrics
2. Determination of the range of variation in the reliability and reproducibility of these metrics across imaging sites and retest study designs
3. Creation of a standard/benchmark test-retest dataset for the evaluation of novel metrics

Given that this was a retrospective data collection, we have focused on basic phenotypic measures that are relatively standard in the neuroimaging field, as well as fundamental for analyses and sample characterization. Our phenotypic key is organized to reflect three classifications of variables: 1) core (i.e., minimal variables required to characterize any dataset), 2) preferred (i.e., variables that were strongly suggested for inclusion due to their relative import and/or likelihood of being collected by most sites), and 3) optional (variables that are data-set specific or only shared by a few sites).

Organizers

Consortium Founders: Xi-Nian Zuo, Michael P. Milham

Project Coordinator: Xi-Nian Zuo

Data Aggregation and Organization: David O’Connor, Daniel Lurie, Erica Ho, Michael P. Milham, Ting Xu, Xi-Nian Zuo

Website: Daniel Lurie

Database Support: Vince Calhoun, Wil Courtney, Margaret King

Contributors

• Jeffrey S. Anderson, University of Utah
• Pierre Bellec, Centre de recherche de l’institut de Gériatrie de Montréal
• Rasmus Birn, University of Wisconsin
• Janusch Blautzik, Ludwig-Maximillians University Munich
• John C. S. Breitner, Douglas Institute, McGill University
• Randy Buckner, Harvard University
• Vince Calhoun, University of New Mexico
• F. Xavier Castellanos, NYU Child Study Center
• Antao Chen, Southwest University
• Bing Chen, Hangzhou Normal University
• Jiangtao Chen, Southwest University
• Xu Chen, Southwest University
• Stanley J. Colcombe, Nathan Kline Institute
• Cameron Craddock, Child Mind Institute
• Adriana Di Martino, NYU Child Study Center
• Xiaolan Fu, Institute of Psychology, Chinese Academy of Sciences
• Qiyong Gong, Sichuan University
• Yong He, Beijing Normal University
• Tiangzi Jiang, Institute of Automation, Chinese Academy of Sciences
• Yi Jiang, Institute of Psychology, Chinese Academy of Sciences
• Clare Kelly, NYU Child Study Center
• William Kelley, Dartmouth College
• Stephen M. LaConte, Virginia Tech Carillion Research Institute
• Janet E. Lainhart, University of Wisconsin - Madison
• Xu Lei, Southwest University
• Hui-Jie Li, Institue of Psychology, Chinese Academy of Sciences
• Kaiming Li, Sichuan University
• Kuncheng Li, Beijing Xuanwu Hospital
• Qixiang Lin, Beijing Normal University
• Dongqiang Liu, Hangzhou Normal University
• Jia Liu, Beijing Normal University
• Xun Liu, Institute of Psychology, Chinese Academy of Sciences
• Yijun Liu, Southwest University
• Jie Lu, Xuanwu Hospital
• Guangming Lu, Nanjing Jinling Hospital
• Beatriz Luna, University of Pittsburgh
• Jing Luo, Capital Normal University
• Ying Mao, Fudan University
• Andrew R. Mayer, Mind Research Network
• Daniel Margulies, Max Planck Institute for Human Cognitive and Brain Sciences
• Thomas Meindl, Ludwig-Maximilians-University
• Mary E. Meyerand, University of Wisconsin - Madison
• Michael P. Milham, Nathan Kline Institute
• Weizhi Nan, Institue of Psychology, Chinese Academy of Sciences
• Jared A. Nielsen, University of Utah
• David Paulsen, University of Pittsburgh
• Vivek Prabhakaran, University of Wisconsin - Madison
• Jiang Qiu, Southwest University
• Chunhong Shao, Fudan University
• Weijun Tang, Fudan University
• Arno Villringer, Max Planck Institute for Human Cognitive and Brain Sciences
• Huiling Wang, Institue of Psychology, Chinese Academy of Sciences
• Kai Wang, Institue of Psychology, Chinese Academy of Sciences
• Dongtao Wei, Southwest University
• Gao-Xia Wei, Institue of Psychology, Chinese Academy of Sciences
• Xuchu Weng, Hangzhou Normal University
• Xuehai Wu, Fudan University
• Ting Xu, Institue of Psychology, Chinese Academy of Sciences
• Zhi Yang, Institue of Psychology, Chinese Academy of Sciences
• Yu-Feng Zang, Hangzhou Normal University
• Qinglin Zhang, Southwest University
• Zhiqiang Zhang, Nanjing University
• Ke Zhao, Institue of Psychology, Chinese Academy of Sciences
• Zonglei Zhen, Beijing Normal University
• Yuan Zhou, Institue of Psychology, Chinese Academy of Sciences
• Xi-Nian Zuo, Institue of Psychology, Chinese Academy of Sciences

Acknowledgements

The National Institute on Drug Abuse (NIDA) and the National Natural Science Foundation of China (NSFC) have been instrumental in the CoRR collaboration providing the necessary funding and manpower to build the foundation of the project along with the Child Mind Institute, the Institute of Psychology, Chinese Academy of Sciences and the Nathan Kline Institute.